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Abstract — This paper proposes a multiple-model adaptive 
control methodology, using set-valued observers (MMAC-SVO) 
for the identification subsystem, that is able to provide robust 
stability and performance guarantees for the closed-loop, when 
the plant, which can be open-loop stable or unstable, has sig- 
nificant parametric uncertainty. We illustrate, with an example, 
how set-valued observers (SVOs) can be used to select regions 
of uncertainty for the parameters of the plant. We also discuss 
some of the most problematic computational shortcomings and 
numerical issues that arise from the use of this kind of robust 
estimation methods. The behavior of the proposed control 
algorithm is demonstrated in simulation. 

I. Introduction 

In many realistic applications, the model of a system is 
only known up to some level of precision, due to uncertain 
parameters and unmodeled dynamics. Sometimes, a robust 
non-adaptive controller is enough to achieve the desired 
closed-loop performance, e.g., to guarantee a given level of 
attenuation from the exogenous disturbances inputs to the 
performance outputs. If, however, the region of uncertainty 
is large and/or there are stringent performance requirements, 
such a non-adaptive controller may not exist. To overcome 
this problem, several solutions are proposed in the literature 
of adaptive control. 

In this paper, we consider an important class of adaptive 
control architectures, referred to as multiple-model adaptive 
control (MMAC). In particular, we are going to address the 
case where the process model has one parametric uncer- 
tainty, p e [pmin, Pmax]- Although several switching MMAC 
methodologies are available to solve this problem, they all 
share the same principles: in terms of design, we divide the 
(large) set of parametric uncertainty, K, into N (small) sub- 
regions, Ki, i = {1, • • • , N} - see Fig.[T|- and synthesize a 
non-adaptive controller for them; in terms of implementation, 
we try to identify which region the uncertain parameter, p, 
belongs to, and then use the controller designed for that 
region. As explained in the sequel, the approach presented 
herein discards the regions where the uncertain parameter, 
p, cannot belong. 
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Fig. 1. Uncertainty region, K, for the parameter p, split into N subsets. 

For a list of advantages of this type of control see, for 
instance, [1]. Several MMAC architectures have been pro- 
posed that provide stability and/or performance guarantees 
as long as a set of assumptions are met. For instance, [2] 
uses a parameter estimator to select a controller, guaranteeing 
stability of the closed-loop. Another MMAC, the so-called 
robust multiple-model adaptive control (RMMAC), intro- 
duced in [3] and references therein, uses a bank of Kalman 
filters for the identification system and a hypothesis testing 
strategy to select the controllers. For this case, although the 
simulation results indicate that high levels of performance 
are obtained, the only guarantees that can be provided are 
in terms of stability - see [4]. In [5], calibrated forecasts 
are used to guarantee the stability of the closed-loop. The 
theory of unfalsified control - see [6] and references therein 

- uses the controlled output error to decide whether the 
selected controller is delivering the desired performance or 
not. The authors in [7] use a Lyapunov-based approach to 
select controllers, and hence require an in-depth knowledge 
of the plant. Some of the assumptions required by these 
methodologies are often unnatural or cannot be verified in 
practice. 

The approach in this paper is somewhat different to the 
above MMAC architectures. Instead of trying to identify the 
correct region, i.e., the region where the uncertain parameter 
takes value, by hypothesis testing or parameter estimation, 
we exclude the wrong regions. In other words, if the time- 
evolution of the inputs and outputs of the plant cannot be 
explained by a model with uncertain parameter p, such 
that p S Ki, then region Kf cannot be the one which 
the uncertain parameter belongs to. For dynamic uncertain 
models, described by differential inclusions, this can be 
posed as the problem of tracking a differential inclusion 

- we remark that there is a rich set of references in the 
mathematical literature on differential inclusions as discussed 
in [8], [9], [10]. 

For linear dynamic models, the problem of "disqualifying" 
regions can be tackled using set-valued observers (SVOs) for 
linear systems - see [11]. These observers consider that the 
initial state of the system is uncertain, that there are dis- 
turbances acting upon the plant, and that the measurements 
are corrupted with noise. Therefore, the state estimate, at 
each sampling time, is a set, instead of a single point. In 



this paper, we generalize the observers in [11] to uncertain 
models and provide sufficient conditions for the convergence 
of the SVOs implemented in a non-ideal environment. 

In summary, the approach in this paper is to use SVOs to 
decide which non-adaptive controllers should not be selected. 
Similarly to other MMAC architectures, we use a bank of 
observers - in our case, SVOs -, each of which tuned for a 
pre-specified region of uncertainty. However, we utilize the 
observers to discard regions, rather than to identify them. 
Using this strategy, we are able to provide robust stability 
and performance guarantees for the closed-loop, even when 
the model of the plant is uncertain. Moreover, we are able 
to handle both stable and unstable systems. 

This paper is organized as follows: section illustrates, 
with an example, how set-valued observers can be used to 
select regions of uncertainty for the parameters of the plant, 
while stressing some of the computational shortcomings and 
numerical issues that arise from the use of this method; 
section [Til] deals with some of the issues related to the dis- 
cretization of continuous-time uncertain models and points 
out some common problems in systems with different sam- 



pling times; section IV is devoted to the integration of set- 
valued observers with a multiple-model control architecture; 
finally, some general comments on the results obtained are 
provided in section [V] 

II. Set- Valued Observers 



for every z = Ax(k — 1), |A| < 1, where 1 is a column 
vector of l's with the adequate length, and where 
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for each value of x(k — 1), |2]) must be verified for ev- 
ery d such that \d\ < 1, and every z £ Z(x(k — 1)), 
where Z (x(k — 1)) := co {x(k — 1), — x(k — 1)}, and 
co {pi, . . . ,p m } is the smallest convex polytope contain- 
ing the points pi,...,p m , also known as convex hull of 
pi, . . . ,p m . Notice that the sensor noise is accounted for 
in vector m(k). 

For each x(k — 1), we have z = Ax(k — 1), for all A e M 
such that |A| < 1. Notice that z = Ax{k - 1), |A| < 1 =>■ 
\zi\ < \xi{k — 1)|. Thus, the constraints in z can be relaxed 
to 

\zi\<\xi{k-l)\,i = l,...,n. (3) 
Hence, for x € K 2 , A e K, we have 

x(k)e (J Set(M t (k),m t (k)), (4) 



Set-Valued Observers for Uncertain Plants 

The results presented in this section are a generalization of 
the ones in [11] to models with parametric uncertainties. Due 
to space limitations, some intermediate calculations are going 
to be omitted. Consider a plant described by the following 
discrete-time model: 

f x(k + l) = A(k)x(k) + A^{k)x(k) + L d (k)d(k) + B(k)u(k) 
\ y(k) = C{k)x{k) + n{k), 

(1) 

where x(0) G X(0), d{k) with \d{k)\ = max\di(k)\ < 1 

i 

are the disturbances, n{k) with \n(k)\ — max|rii(fc)| < 1 

i 

is the sensor noise, u{k) is the control input, y(k) is the 
measured output, a; (A;) is the state of the system and X(0) := 
Set(Mo, mo), where Set(M, m) :— {q:Mq<m}. Fur- 
thermore, we assume that A&(k) — Ai(k)Ai(k) + ... + 

A 

A. 

while the matrices Ai, i = {1, . . . , ua}, are the directions 
which those uncertainties act upon. Therefore, in ([TJ we are 
accounting for models with parametric uncertainty, which is 
critical for adaptive control. For the sake of simplicity, we 
assume ua = 1, and define A := Aj. Then, x(k) satisfies 



where m^k) — [m(k) 0] T and 



A nA (k), for |Aj| < l,i = 1, ...,tia- The scalars 
i = {!,..., tia}, represent parametric uncertainties, 
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Although Q does not define, in general, a convex set, it 
can be overbounded by a convex polytope, represented as 
X(k) = Set(M(fc),m(fe)). 

As a final remark, we stress that the computation of X(k), 
based upon X(k — 1), can then be obtained by applying the 
Fourier-Motzkin elimination method (see [11], [12]) to 

Computational and Numerical Issues 

This subsection presents a discussion on some of the most 
important computational and numerical shortcomings of this 
methodology. 



Fourier-Motzkin Elimination Method: The first issue is 
related to the implementation of the so-called Fourier- 
Motzkin elimination method, described in [12], that projects 
polyhedral convex sets on to subspaces. 

The Fourier-Motzkin algorithm leads to a set of linear 
inequalities, where some of them might be linearly depen- 
dent. This may be problematic, since the size of M(k) and 
m(k) could be increasing very fast with time. To overcome 
this problem, one has to eliminate the linearly dependent 
constraints. This can be done by solving several small linear 
programming problems at each sampling time, making the 
practical implementation of this type of observers somewhat 
computationally complex. 

Union of Convex Polytopes: We also have to implement 
the union of several polytopes. This task can be done by 
noting that, in our case, 

I^J set(M, m) C co {set(Mi, mi), . . . , Set(M 2 ™, m 2 ™)} . 

f=l,...,2 n 

In one- or two-dimensional spaces, this can be easily imple- 
mented. For higher dimensional spaces, one can resort, for 
instance, to the algorithm in [13]. 

Numerical Approximation of Convex Polytopes: Another 
possible shortcoming of the SVOs is related to the numerical 
approximations used during the computation of the set- 
valued estimations. In other words, since we do not have 
infinite precision in the computations that have to be carried 
out every sampling time to obtain the set-valued estimate 
X(k), the actual set where the state can take value, X(k\ 
need not be entirely contained inside X(k) - see Fig. pi 
Therefore, it may happen that the true state does not belong 
to X(k), and hence we may end up by possibly discarding 
the region which the parameter actually belongs to. 

Thus, a very simple solution is to "robustify" the algorithm 
by slightly enlarging the set X(k), as illustrated in Fig. [2] 
As long as the maximum error in the computation of the 
set X(k) is known, we have, for every sampling time, k, a 
vector e*(k) such that X{k) C Set (M(fc), m(k) + e*(k)) . 




Fig. 2. Overbound of set X(k) to include X(k). 

Convergence of the Set-Valued Observers: Using an over- 
bound to guarantee that we do not disqualify the correct esti- 
mator also has its shortcomings. Besides adding conservatism 
to the solution, it may be responsible for the unbounded 
increase with time of the area of the polytope of the set- 
valued estimate. 



The remainder of this subsection is devoted to the deriva- 
tion of sufficient conditions that guarantee that, if X(k) is 
bounded, so does X(k). Consider a plant described by ([T| 
with A A (k) = and X(0) bounded. 

The first thing to realize is that the eigenvalues of A 
must belong to the unit circle, so that we can guarantee 
that X(k) is bounded. We assume the stability (and, hence, 
detectability) of the plant throughout the subsection, i.e., the 
eigenvalues of A are inside the unit circle. However, the 
SVOs can be used with unstable plants. 

Let ^(fc) be the smallest hyper-cube centered at the origin 
that contains the set X(k), as depicted in Fig. [3] Define e(k) 
as the maximum distance between a facet of ^(k) and the 
corresponding facet of the estimate ^f(k), as depicted in Fig. 
[3] Next, we try to derive sufficient conditions to guarantee 
that is bounded. It should be noticed that \&(fc) can be 
interpreted as a rough approximation of X(k), in the sense 
that X(k) C ^>(k), which means that if ^>(k) is bounded, so 
does X(k). 
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Fig. 3. Bounding set ty(k), corresponding estimate S'(fe), and maximum 
numerical error e(k). 

Proposition 1: Consider an asymptotically stable plant 
described by ([TJ with the aforementioned constraints. Sup- 
pose that the maximum numerical error (previously defined) 
at every sampling time is e(k), with e(fc) < e*|a^j(fc)|, for 
some < e* < 00 and for every x(k) S X(k). Further 

\Ax\ 

suppose that e* < 1 — II All, where II All := sup —. — r . Then, 

x \X\ 

^>(k) is bounded. 

Proof: Define 8 :— sup\Ld(k)\. Notice that 8 is 

k 

bounded, since \d\ < 1. Then, \x(k + 1)| < ||A|||x(»| + 8. 
Since the eigenvalues of A are inside the unit circle, we can 
find 7 > such that ||A|| < 1 — 7. Hence 



\x(k + l)\ < (1 



1 



7)Kfc)l 
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x{k)\-l\x{k)\ + 8, 
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for any j ^ 0. Thus 
j > 0, we have 



for sufficiently large \x(k)\ and 
0, which leads to 



-j\x(k)\ + 8 = 



\x(k+l)\ < [l-(i=!) 7 ] \ x (k)\ 



However, to overcome 
the aforementioned numerical issues, we overbound this set 



1 



(f) 



7 + e* 



j(fc)|. If e* < 



3-1 



7. 



by (2:0 + 1)1 < 

then \x(k + 1)| < |x(fc)|. Taking the limit as j tends to 
infinity leads to the desired result. ■ 
Remark 1 In an intuitive manner, the above implies that 
systems that drive their states to zero rapidly can have larger 
overbounds in the sets X(k) than slower systems, o 



Corollary 1: Consider a stable plant described by ([T| with 
the aforementioned constraints. Suppose that the maximum 
numerical error at every sampling time is e, with < e < oo. 
Then, ifr(k) is bounded. 

Proof: Using a similar approach to that in the previous 



proposition, we get \x(k 
for any j > 



1)1 < 



1 



3-1 
j 



j-1 
3 

and sufficiently large 



\x{k)\ 



I I — j 7 

x(k)\. Thus, 

7 | a; (A;) | + |e| < (1 - p) \x(k)\, with p > 0, 
which concludes the proof. ■ 
Remark 2 We stress that this type of errors can be 
modeled as an exogenous disturbance. This is in agreement 
with Corollary 1, since the only requirement is for the system 
dynamics matrix to be Hurwitz. o 

As explained later, these shortcomings of the SVOs do not 
jeopardize the implementability of the algorithms. In fact, 
although some of the constraints seem very stringent from a 
practical point of view, they may not be relevant when used 
to discard regions in a MMAC architecture. For instance, 
all the calculations above are only valid for stable plants. 
Nevertheless, the MMAC architecture with SVOs, introduced 
in the sequel, can be used to control open-loop unstable 
plants. This topic will be subject to further discussion. 

Mass-Spring-Dashpot Plant 

We are now going to evaluate the applicability of the SVOs 
using a simple example. Consider the mass-spring-dashpot 
(MSD) plant depicted in Fig. |4] The unknown spring constant 



Fig. 4. MSD system with uncertain spring constant, k\. 

is k\ £ [1, 5] N/m. At this point, we consider «(•) = 0. 
The disturbances and the sensor noise were obtained from 
uniform random numbers generators, with \d\ < 1, \n\ < 0.1. 

Simulations 

We recall that we are trying to derive a multiple-observer 
system that is able to discard uncertainty regions for the un- 
known parameters of the plant. Hence, we start by designing 
an SVO for the aforementioned MSD plant, with uncertain 
parameter fci, such that k\ £ K\ := [1, 5] N/m. At each 
sampling time kT s , the SVO produces a set-valued estimate 
of the state of the plant, by means of a set, X(k). If the 
actual process is in agreement with the model of the MSD 
plant, for k\ £ K\, then the set X(k) can never be empty. 
If, however, there is a mismatch between the model and the 
actual plant, caused, for instance, because k\ ^ K\, then 
the set X(k) may be empty, for some integer k > 0. Thus, 
we use the SVO - designed for the uncertain MSD plant 
with fci £ [1, 5] N/m - to estimate the state of the plant for 
different values of ki. 

As illustrated in Fig. [5] the number of iterations to discard 
a region may be arbitrarily large, and is mainly dependent 



Fig. 5. Expected value of the number of iterations required to disqualify 
region [1, 5] N/m as function of the spring constant, k\. The dashed red 
lines bound the valid region for the parameter. 



upon the disturbances, the sensor noise and the mismatch 
between the model and the actual plant. 

The expected number of iterations for each value of the 
spring constant, depicted in Fig. [5] was obtained by averaging 
the number of iterations required in each simulation, using 
different seeds for the random generators used to emulate the 
disturbances and the sensor noise. It is clear from the figure 
that, as one would expect, the closer the true value of the 
parameter is to the region used to design the observer, the 
longer it will take before we can discard that region. 

III. Discretization Issues 

This section is devoted to an important topic when dealing 
with models of realistic systems. Several plants, like the 
MSD system previously described, are naturally modeled in 
continuous-time. Nonetheless, the aforementioned SVOs can 
only be used with discrete-time system models. The usual 
methods for discretizing LTI systems cannot be readily ap- 
plied to uncertain models. Therefore, we start this section by 
deriving discrete-time uncertain models for continuous-time 
uncertain plants. However, again due to space limitations, we 
are going to mention only the most relevant steps. 

Another important discretization issue is related to the fact 
that the SVOs are usually slow in terms of computation, 
when compared to the dynamics of the plant. In other 
words, it is required, in general, different sampling times for 
the control and decision subsystems of the multiple-model 
adaptive methodology presented in the sequel. Hence, the 
second part of this section tackles the problem of having 
different sampling times for the same plant - the interested 
reader is also referred to [14]. 

Discretization of Continuous-Time Uncertain Models 

Consider a continuous-time LTI stable plant described by 

x{t) = Ax(t) + Bu(t) + Ld(t) 
y(t) = Cx(t) + n(t). 

Let T be the sampling time and assume that u(-) and, for 
the sake of simplicity, d(-), are constant during each sampling 
interval. Then, for t = kT, we can rewrite |5]l as 

x((k + 1)T) = A d x(kT) + B d u{kT) + L d d(kT) 
y(kT) = Cx(kT) +n(kT), 



(5) 



where A d := e , B d := J e Bdr. In the sequel, we Control Architecture 



use k instead of fcT, for the sake of notational simplicity. 

Next, we suppose that A is uncertain. Redefine A := A 
AiA, where |A| < 1. Then, for large T, 



A d = 



AT 



AT 



I + A X TA 



(AiTA) 2 



(6) 



We recall that if A\ is nilpotent, then (|6]l becomes much 
simpler. In particular, suppos^j] that A\ = 0. Then A d — 
6 at _ e AT (I+AiTA) = A d + AfA, where A d := 
e AT , A d := e AT A x T. 

For the discretized B (and L c i) matrix with uncertainty, 
we can rewrite it as B d = B d + db, where db represents a 
fictitious disturbance. However, due to lack of space, these 
calculations are omitted in this paper. 

Sampling of Discrete-Time Models 

Due to the computational requirements associated with 
the set-valued observers (requiring the on-line elimination of 
several linear inequalities), different sampling times should 
be used for the control and for the estimation part of the 
algorithm presented in the next section. Therefore, let T s 
be the sampling time for the SVOs, and T c << T s be the 
sampling time for the controllers. Assume that T s = mT c , 
where m is a positive integer. We further define A s = e ATs , 
and A c = e ATc . We consider that the model used for control 
is described by (omitting the disturbances) 



x(k+l) = A c x(k) + B c u(k), 
y(k) = Cx(k) + n(k). 



Hence, x(k + rn) = A s x(k) + Bu(k), where 

B = [A™~ X B C A™- 2 B C ••■ A C B C B C J , 
u(k) — [u(k) u(k — 1) ••• u(k + m — 1)] . 

Thus, by augmenting the control input, u(-), and using 
n(k) — n(mk), the model used by the SVOs, that is, the 
model with sampling time T s , can be described by 



x(k+l) = A s x(k) + Bu(k), 
y(k) = Cx(k) + n(k). 



IV. Multiple-Model Adaptive Control with 
Set- Valued Observers 

This section is devoted to the application of SVOs to 
multiple-model adaptive control (MMAC-SVO) of time- 
invariant systems. We start by introducing the architecture of 
the control scheme and describing the suggested algorithm. 
Later on, we provide stability and performance guarantees 
for the closed-loop. A set of simulations illustrating the 
applicability of the MMAC-SVO is also presented. 

'Evaluating how restrictive is this assumption is still a topic of research. 



Figure [6] depicts the MMAC architecture adopted to use 
with the SVOs. For the sake of simplicity, suppose that the 
plant depends upon only one uncertain parameter, k\. It is 
known, however, that fc x € K, for some set K C R, The 
methodology very briefly presented next can be generalized 
for plants with a higher number of parametric uncertainties. 

We follow very closely the method presented in [3], to 
design the MMAC-SVO. For starters, we assume that a 
single and non-adaptive controller (referred to as global 
non-adaptive robust controller - GNARC) is not able to 
achieve the desired performance for the whole uncertainty 
region. Therefore, we need to divide this region, K, into 
several smaller regions, say K\,K2,--- ,-?Gv, such that 
K\ 1J K2 U ' ' ' U Kn = K. In order to do so, we first 
compute the maximum (ideal) performance that we can 
achieve. This is obviously the case where we know the 
exact value of the otherwise uncertain parameter, k\. To 
the controllers designed for fixed values of the uncertain 
parameter, k\, we call FNARC (fixed non-adaptive robust 
controller), using the same terminology as in [3]. 



u(k) 



d(k) n(k) 

A i 



.Ij SVO#2 | 
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Fig. 6. Multiple-model adaptive control with set-valued observers (MMAC- 
SVO) architecture. Xi is the set estimated by SVO #i. 



The design proceeds by defining the desired performance 
for the closed-loop, when the parameter fc x is uncertain. 
Without loss of generality, we assume that, for each value of 
the uncertain parameter, k\, we want the performance of the 
MMAC-SVO not to be smaller than a fixed percentage of the 
corresponding FNARC. This naturally leads to the splitting 
of set K into smaller subsets, as previously mentioned. 

For each of these subsets Ki, i = {1, • • • , N}, a controller 
referred to as LNARC (local non-adaptive robust controller) 
is synthesized. We argue that, for any realistic application, 
these LNARCs should also be robust to plant model error in 
addition to parameter k\ . Thus, using an LFT representation 
for the system may be useful if, for instance, mixed-/i 
controllers are used - see [15], [16]. 

Furthermore, an SVO should also be designed for each of 
the subsets, using the methodology previously introduced. It 
is important to stress that the SVO for region Ki should be 
such that, whenever k\ E Ki, the set Xi(k) is never empty. 



Description of the Algorithm 

Having described the architecture and the design proce- 
dure of the MMAC-SVO, we propose an algorithm to select 
the appropriate controller at each sampling time. In reference 
to Fig. [6] this subsection is devoted to the description of the 
behavior of the block entitled Logic. 

Several approaches can be used to tackle this decision 
problem. In this paper, we suggest a very simple solution 
that takes into account the fact that, whenever k\ S Ki, the 
SVO #i does never fail, i.e., Xj(fc) is never empty. On the 
other hand, if k\ ^ Ki, then it can happen that, for some to, 
we have Xi(k) = 0, for all k > to- Based upon these facts, 
we suggest the algorithm depicted in Fig. [7] 



k= 1; t(1) = 1 



■[ i(k+1) = i(k) 




f Use Controller #i(k+1) 



Fig. 7. Algorithm proposed to select an appropriate controller at each 
sampling time. 

We stress that the main advantage of this algorithm is that 
we can guarantee robust stability and performance for the 
closed-loop, as shown in the sequel. 

Proof of Stability 

The proof of stability of the closed-loop is based upon the 
fact that the SVOs are non-conservative, i.e., if Xj(fe) ^ 0, 
then the output of the plant, y(k), can be justified by the 
previous input and outputs, and for some k\ £ Ki. This 
statement will be explained more formally in the sequel. 
Once again, for the sake of simplicity, we use a plant with 
only one uncertain parameter. 

Consider a system described by ([TJ with ua = 1. 

Notice that the nominal plant (Ai(fc) = 0) is a linear 
time-invariant system. Further consider a partitioning of the 
uncertainty set, K, as described in the previous subsection 
(K = Kx |J K 2 |J • • • |J K N ). Moreover, we posit the fol- 
lowing assumptions. 

Assumption 1 For each of the uncertainty subsets, Ki,i — 
{l, -- , N}, there is at least one LNARC, referred to as 
Cj( ), that is able to stabilize any plant with model ([TJ and 
ki G Ki. □ 

Let X(y(k)) = {x : y(k) = Cx + n, \n\ < 1} , and 

Xi(u(k), k) — {x:x=Aw+Bu(k) + L d d,weXi(k-l),\d\<l} . 

Assumption 2 The solution of the SVO #i is given by 

Xi(y(k),u(k),k) = Xi(u(k),k) n X(y(k)). In words, the 
solutions of the SVOs are non-conservative. □ 

Assumption 3 For any sampling time k, x(k) 6 
Xi(y(k),u(k), k), for some i e {!,■■■ , N}. □ 



Notice that Assumption [3] guarantees that the true plant 
model belongs to the family of legal models of at least one 
of the SVOs. 

Assumption 4 The closed-loop system with any of the N 
controllers does not have a finite escape time. □ 

We stress that Assumption [4] is automatically satisfied if 
all the N controllers are LTI systems - see [4]. 

Theorem 1: Suppose Assumptions [T] [4] are satisfied. 
Then, using the algorithm previously described, the closed- 
loop system is input/output stable. 

Proof: We first show that the number of switchings is 
finite. Then, by contradiction, we prove that the closed-loop 
is input/output stable. 

If Xi(y,u, k) = 0, then y(k) cannot be explained by the 
uncertain plant model used by SVO #i. Thus, we switch to 
a different controller. According to Assumption [3] at least 
for one value of j £ {1, ••• , N}, x(k) € Xj(y,u,k),Wk- 
Hence, the number of switchings is finite and smaller than 
N. In other words, for some large enough t , the controller 
selected at time instant k > to is always the same. 

Next, suppose that \y(k) \ — > oo as k — > oo. Let Cj(-) be 
the controller selected for k > to- According to Assumption 
[2] there is a sequence (d(k), n(k)), with \n\ < 1 and \d\ < 1, 
such that y(k) can be obtained with model ([T| with k\ € Kj. 
However, according to Assumptionjl] controller Cj(-) is able 
to stabilize any plant with k\ € Kj. Since \d\ and |n| are 
bounded, and according to Assumption [4] there cannot exist 
a sequence (d(k),n(k)) such that \y(k)\ — > 00, which is a 
contradiction. ■ 

Remark 3 We stress that the proofs of convergence of the 
SVOs, presented in section|lIJ are only valid for stable plants. 
This means that, under suitable conditions, SVO #i must 
converge if LNARC Cj(-) is able to stabilize the plant, since 
in that case the closed-loop system is stable. If, however, 
controller Ci(-) is not able to stabilize the plant, then SVO 
#z may not converge. Nonetheless, this is not a shortcoming, 
since a non-converging SVO of an unstable plant is always 
discarded, as shown in the proof of Theorem [TJ Therefore, 
a LNARC that is not able to stabilize the plant (in the 
input/output sense) is always discarded, as demonstrated 
above, o 

Proof of Performance 

Finally, we provide performance guarantees for the closed- 
loop system using the MMAC-SVO. For that, we need 
the following additional assumptions. We define £(fc) = 
[d(k), n(k)] as the performance input vector, and z(k) as 
the performance output vector. In the sequel, we consider 
that z(k) = y(k), that is, the performance and measurement 
outputs are the same. 

Assumption 5 Let ki G JQ. Then, controller Cj(-) stabi- 
lizes the plant and guarantees a closed-loop £ 2 -induced norm 
from the performance inputs to the performance outputs 
smaller than 7. □ 

Remark 4 Assumption [5] ensures the existence of a non- 
adaptive controller for each value of ki E K that provides 



V 

t>tn 



□ 



the specified performance requirements. 
Assumption 6 Let k\ G Ki. Then 

V 3 : Xj(t) = 

H<l,|d|<l U*M 
»(«)eJt(0) 

Remark 5 Assumption [6] can be stated as follows: for 
every initial state in X(0), there is a set of input sequences, 
U*, such that, for any u*(k) G U* , k = {1,2, ••■}, 
and for sufficient large k, all the SVOs except one (SVO 
#z) have failed. This assumption can also be seen as a 
distinguishability condition, o 

Theorem 2: Suppose Assumptions [3j-|6] are satisfied. Fur- 
ther suppose u(k) G U* . Then, for some large enough time 
instant t\, the £2 -induced norm from the performance inputs 
to the performance outputs, for k > t\, is smaller than 7. 

Proof: According to the proof of Theorem [T] there is a 
time instant to such that, for k > to, the selected controller 
is Cj(-), for some j £ {l,-" >-W}- Hence, we only need 
to prove that this controller guarantees a closed-loop C2- 
induced norm from the performance inputs to the perfor- 
mance outputs smaller than 7. According to Assumption [5] 
such controller exists and, if k\ E Ki, then Cj(-) = £?»(•), 
i.e., j — i. Thus, if, for a large enough time instant, k, all 
but SVO ■#■{ fail, the proof is complete. This, in turns, is 
guaranteed by Assumption [6] 

■ 

Assumption [6] is somewhat unnatural and hard to verify in 
general. Therefore, we can discard it at the cost of getting a 
weaker performance index. 

Theorem 3: Suppose Assumptions |2] — [5] are satisfied and 
that the closed-loop system, for fixed controllers, is linear. 
Further suppose there exists £, such that |£(fc)| < £. Then, 
we have \z(k)\ < 7^ as k — > 00. 

Remark 6 We stress that the performance guarantees 
provided by Theorem [3] are weaker than those of Theorem 
To see this, let |£| < fi. However, suppose that we only 
know an upper bound for £1, referred to as £ 2 > sucn that 
£2 > £,i- Then, if Assumptions [2] |6] are satisfied, Theorem [2] 
guarantees that \z\ < 7^1. If Assumptions [2] [5] are satisfied, 
Theorem [3] guarantees that \z\ < 7^2 > 7£i (as k — > 00). 
o 

Proof: The proof of Theorem [3] follows closely the 
proof for stability and is omitted due to lack of space. ■ 

Simulation: Stable Plant 

We illustrate the applicability of the MMAC-SVO with 
an example. Recall the MSD plant depicted in Fig. |4] We 
use a sampling time of T c — 1 ms for the controllers, 
and a sampling time of T s — 500 ms for the SVOs. 
The discretization of the plant is done based upon the 
methodology previously described. The uncertainty region 
considered is K — [0.25, 9.25] N/m. This (large) region was 
divided into the following 3 regions, Ki, for i = {1,2,3}, 
and, for each region, a mixed-/i controller that is able to 
guarantee a certain level of performance was synthesized: 
K x = [0.25, 5.0] , K 2 = [5.0, 7.0] , K 3 = [7.0, 9.25] . 



In the following simulations, we consider that the initial 
LNARC selected is Ci( ), that is, the mixed-/i controller 
designed to guarantee robust performance for the uncertainty 
region K\. If SVO #1 fails, then we switch to controller 
C 2 (-)- If SVO #2 also fails, we switch to controller C 3 (-). 
Notice that at least one of three SVOs cannot fail. 

The first simulation was obtained by using k\ € K\. 
Since we start-up with controller Ci(-), there is no need 
for switching. The result is depicted in Fig. [8] 




Fig. 8. Output of the closed-loop for the MSD-plant with positive k\ £ K\ . 

For the second simulation run, we used k\ € K 2 . The 
initial controller is G\{f), i.e., we assume that the uncertain 
plant belongs to K\. However, after two sampling times of 
the identification scheme, T s = 500 ms, the SVO #1 is not 
able to explain the measured output, and hence we switch 
to controller C2Q. Since the SVO #2 does not fail, we 
continue using controller Ci{-), as depicted in Fig. [9] 




Fig. 9. Output of the closed-loop for the MSD-plant with positive fci S K2. 
The red dashed line indicates the time instant at which the SVO #1 failed, 
and hence the logic switched to controller #2. 



For the last simulation, we used a model with k\ 
As depicted in Fig 



10 



G K 3 . 
1 s and 



SVOs #1 and #2 fail at t 
t = 1.5 s, respectively. Although C2O) is able to stabilize the 
plant, the algorithm can still decide to switch to controller 
C 3 (-), since the SVO #2 fails. 

It should be noticed that, the smaller the amplitudes of 
the input and output signals, the harder it is, in general, to 
discard an uncertainty region, because the models become 



Fig. 10. Output of the closed-loop for the MSD-plant with positive fci £ 
K3. The red dashed lines indicate the time instants at which the SVO #1 
and #2 failed, and hence the logic switched to controller #3. 



less distinguishable. However, we stress that, for the values 
of the spring constant used, all the controllers were able to 
stabilize the plant. Nevertheless, the algorithm always picked 
the controller that provided the performance level we were 
expecting. 

Remark 7 For this plant, we have to solve around 10 
to 30 linear programs, up to 20 times per iteration, which 
requires approximately 500 ms or less in a Core 2 Duo 
Pentium™ processor at 2.0 Ghz. o 

Simulation: Unstable Plant 

In this subsection, we make the open-loop plant unstable 
by using a negative spring stiffness coefficient. 

The uncertainty region considered is K = [—42, —0.25] 
N/m. This region was divided into the following 3 regions, 
Ki, for i — {1,2,3}, and, for each region, a mixed- 
/x controller that is able to guarantee a certain level of 
performance was synthesized: A'i = [—1.65, —0.25] , K2 = 
[-13.5, -1.65] , K 3 = [-42, -13.5] . 

As in the previous subsection, in the following simulations, 
we consider that the initial controller selected is Ci(-). The 
first simulation was obtained by using k\ E K\. Since we 
start-up with controller Ci(-), there is no need for switching, 



as depicted in Fig. 11 




For the second simulation run, we used fej £ K 2 - The 
initial controller is C\(-), i.e., we assume that the uncertain 
plant belongs to K±. However, after 1 sampling interval of 
the identification scheme, T s — 500 ms, SVO #1 is not 
able to explain the measured output, as shown in Fig. [12] 
and hence we switch to controller C^-). Since the SVO #2 
does not fail, we continue using controller C^-)- 




Fig. 12. Output of the closed-loop for k\ £ K2 and open-loop unstable 
MSD-plant. The red dashed line indicates the time instant at which the SVO 
#1 failed, and hence the logic switched to controller #2. 



For the last simulation, depicted in Fig. 13 we used a 
model with ki € K 3 . The SVOs #1 and #2 fail at t = 500 
ms and t = 1 s, respectively. 



Fig. 11. Output of the closed-loop for k\ £ K\ and open-loop unstable 
MSD-plant. 



Fig. 13. Output of the closed-loop for k\ £ K3 and open-loop unstable 
MSD-plant. The red dashed lines indicates the time instants at which the 
SVO #1 and #2 failed, and hence the logic switched to controller #3. 

It should be noticed that, the smaller the amplitudes of 
the input and output signals, the harder it is, in general, 
to discard an uncertainty region, because the differences 
between models become less visible. 

V. Conclusions 

This paper illustrated how to use set-valued observers 
(SVOs) in a multiple-model adaptive control (MMAC) ar- 
chitecture, providing robust stability and performance guar- 
antees for plants with uncertain models. The solution pre- 
sented can be obtained in a straightforward manner from the 
discrete-time state-space representation of the plant model. 
This MMAC architecture is able to handle both stable and 



unstable uncertain systems, as illustrated with the simulation 
of a mass-spring-dashpot (MSD) plant. 

In this paper, the applicability of the SVOs was extended 
to plants with parametric uncertainty. We further overcame 
some numerical issues related to the implementation of the 
SVOs, by making the algorithms involved more robust to 
numerical errors. 

As a shortcoming of this approach, the computational 
burden associated with the implementation of the SVOs is 
highlighted. 
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